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Abstract 

I 

|| We study the optimal execution problem in the market model in consideration of mar- 
ket impact. First we study the discrete-time model and describe the value function 
with respect to the trader's optimization problem. Then, by shortening the intervals of 
execution times, we derive the value function of the continuous-time model and study 
some properties of them (continuity, semi-group property and the characterization as 
the viscosity solution of HJB.) We show that the properties of the continuous-time value 
function vary by the strength of market impact. Moreover we introduce some examples 
of this model, which tell us that the forms of the optimal execution strategies entirely 
change according to the amount of the security holdings. Q 

Keywords : Optimal execution, market impact, liquidity problems, HJB, viscosity 
solutions 



1 Introduction 

The optimal portfolio management problem has been developed in jTTj , [18] and in other 
papers. These classical financial theories assumed that the assets in the market are perfectly 
liquid. But in the real market we face various liquidity risk. For instance, the problem of 
transaction costs and the uncertainty of trading. 

Another important problem of liquidity is market impact (MI), that is the effect of the 
investment behavior of traders on the security prices. Such problems are often discussed in 
the framework of the optimal execution problems, where a trader has a certain amount of a 
security holdings (shares of a security held) and tries to execute until the time horizon. [2] 
and [5] studied the optimal execution problem in the discrete-time market model with MI, and 
computed the optimal execution strategy explicitly in the linear MI model. [S], [22], and [23] 
studied the optimization problem in continuous-time model as the singular / impulse control 
problem. [7] studied such problems in the framework for mean-variance analyses. [21] treated 
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the infinite time horizon case. Also studied was the optimal execution problem in limit order 
book market ([!]). 

Recently there have been various studies about the optimization problem with MI, but the 
standard framework has not been fixed yet. In this paper, we try to construct the framework 
of such a model. We formulate the optimal execution problem in discrete-time model first, 
and then derive the continuous-time model by taking the limit. 

We consider the case when MI function is convex with respect to the execution volume of 
a trader, whereas some empirical studies tell us that MI function is concave ([3] etc.) But it 
is important to consider the case when MI is convex, and it is interesting that we can observe 
the very effect of MI which affects the trader's execution policy. 

This paper is organized as follows. In Section [5] we introduce our model. We formulate 
mathematically a trader's optimization problem in discrete-time model, and give some as- 
sumptions to derive the continuous-time model. In Section [3] we give our main results. We 
show that value functions in discrete-time model converge to the one in continuous-time model. 
Then we study some properties of the continuous-time value function : continuity, semi-group 
property and the characterization as the viscosity solution of a certain HJB. Moreover we have 
the uniqueness result of the viscosity solution of HJB when MI is strong (in some meanings 
to be discussed later.) In Section H] we also consider the case that a trader needs to sell up 
entire shares of the security. We show that such a sell-out condition does not influence the 
form of continuous-time value function in our model. In Section [5] we treat some examples of 
our model. We conclude this paper in Section El In Section [3, we list proofs of our results. 

2 The Model 

In this section we present the details of the model. Let T , (jF t ) < t < T , P) be a filtered space 
which satisfies the usual condition (that is, {Ttjt is right-continuous and JF contains all of 
P-null sets) and let (B t )o<t<T be a standard one- dimensional (jF t ) r Brownian motion. Here 
T > means a time horizon. For brevity we assume T = 1. 

We suppose that the market consists of one risk-free asset (namely cash) and one risky 
asset (namely security.) The price of cash is always equal to 1, which means that a risk-free 
rate is equal to zero. The price of a security fluctuates according to a certain stochastic flow, 
and is influenced by sales of a trader. 

First we consider the discrete-time model with time interval 1/n. We consider a single 
trader who has an endowment $ > shares of a security. This trader executes the shares <3>o 
over a time interval [0, 1], but his/her sales affect the prices of a security. We assume that the 
trader executes only at time 0, 1/n, . . . , (n — l)/n for n G N = {1, 2, 3, . . .}. 

Now we describe the effect of the trader's execution. For I = 0, . . . , n, we denote by S™ the 
price of the security at time l/n and X] 1 = logS™. Let so > be an initial price (i.e. Sq = s ) 
and Xq = log So- If the trader sells the amount ip™ at time l/n, the log-price changes to 
X™ — g n (?/;™), where g n : [0, oo) — > [0, oo) is a non- decreasing and continuously different iable 
function which satisfies gVi(0) = 0, and he/she gets the amount of cash ij)?S? exp(— g^ip™)) as 
proceeds of the execution. 

After the trading at time l/n, X™ +1 and S™ +1 are given by 

Xr +1 =y(^tll xp-shW)), Sr +1 = exp(A7 +1 ), (2.1) 
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where Y(t;r, x) is the solution of the following stochastic differential equation (SDE) 



dY{t;r,x) = a{Y{t;r,x))dB t + b{Y{t;r,x))dt, t > r, 
Y(r\ r,x) — x 

and b, a : R — > R are Borel functions. We assume that b and a are bounded and Lipschitz 
continuous. Then for each r > and x G R there exists a unique solution of (12. 2\\ . 

At the end of the time interval [0,1], The trader has the amount of cash W™ and the 
amount of the security where 

w? +1 = wp + ws? e*p{-9nm), ^ = # - (2.3) 



for I = 0, ... ,n — 1 and = 0, </?q = $o- We say that an execution strategy (^>[ 



admissible if (ipf)i G A™(<& ) holds, where A^((p) is the set of strategies (ip?)i = o such that 



n\n— 1 
=0 



is 



fc-1 

is jF^-measurable, ip"? > for each I — 0, . . . , k — 1, and — V 9 - 

A trader whose execution strategy is in A™($o) is permitted to leave the unsold shares of 
the security, and there will be no penalty if he/she cannot finish the liquidation until the time 
horizon. In Section IH we consider the case when a trader must finish the liquidation. 

The investor's problem is to choose an admissible strategy to maximize the expected utility 
E[u(W™, <p™, S™)], where u G C is his/her utility function and C is the set of non-decreasing, 
non-negative and continuous functions on D = R x [0, $o] x [0, oo) such that 

u(w,<p,s) < C u (l + w m " + s m "), (w,<f,s)eD (2.4) 

for some constants C u > and m u G N. 

For k = l,...,n, (w,tf,s) G D and u G C, we define the (discrete-time) value function 

V fc n (u;, <p, s;w) by 

V k n (w, <p, s; u) = sup E[«(W?, ^, S?)] 

subject to (J2IIJ) and (ED for Z = 0, . . . , k - 1 and (W n , S$) = (w, <p, s). (For s = 0, we set 
SJ* = 0.) We denote such a triplet (W/\ ipf, ^ n )to b Y V. s ; WW- For ^ = 0, we denote 

Vq(w, <f, s; u) = u(w, if, s). Then our problem is the same as V^(0, $o, s ; w). We consider the 
limit of the value function V^(w, ip, s; u) as n —> oo. 

Let h : [0, oo) — > [0, oo) be a non-decreasing continuous function. We introduce the 
following condition. 

[A] lim sup -^-g n (ip) ~ h(nijj) ■ 
"">e[o,*o] dtp 



n—*oo , 



where 



Let g(() = / h((')d(' for £ G [0, oo). Under the condition [A], we see that e n — ► 
Jo 

9nW g{nip) 



sup 

</>e(o,$ ] 



■0 



(2.5) 
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Now we define the function which gives the limit of the discrete-time value functions. For 
t G [0,1] and <p G [0, $o] we denote by At(<fi) the set of (jF r ) < r <rprogressively measurable 

process (( r )o<r<t such that ( r > for each r G [0, t], / ( r dr < if almost surely and sup Cr(^) < 

Jo r,u> 

oo. For t G [0, 1], (w, <p,s) G D and u G C, we define V^w, 99, s; -u) by 

Vt(u>,</?, = sup E[w(W t , <^ t) 5*)] 

(Cr)rGA(^) 

subject to 

dW 7 ,. = ( r S r dr, d(p r = —( r dr, dS r = a(S r )dB r + b(S r )dr — g(( r )S r dr (2.6) 

and (Wo,ipo, So) = (w,cp,s), where er(s) = sa(log s), b(s) = s|fe(logs) + -<r(logs) 2 |. When 
s > 0, we obviously see that the process of the log-price of the security X r = log 5V satisfies 

dX r = a(X r )dB r + b(X r ) - g{Qdr. 

We denote such a triplet (W r , <p r , SV)o<r<t by St(u>, 9?, s; (Cr)r)> an d (Wn ^r, -Xr)o< r << by 

S t s; (Cr)r), respectively. We remark that Vo(w, (p, s; u) = u(w,(p,s). We notice that 

Vt(w, <f, s; u) < 00 for each t G [0, 1] and (w, <p,s) G D (see Lemma [6] in Section mi ) 



3 Main Results 

In this section we present main results of this paper. First we give the convergence theorem 
for value functions. 

Theorem 1. For each (w,(p,s) G D, t G [0, 1] and u G C it holds that 

lim V[" tl (tu,<p, s ', u ) = V t (w,tp,s;u), (3.1) 

n— *oo 1 J 

where [nt] is the greatest integer less than or equal to nt. 

The proof is given in Section 17.21 Theorem [T] implies that an optimal execution problem 
in continuous-time model is derived as the limit of the ones in discrete-time model. We 
call Vt(w, <f, s; u) a continuous-time value function. We regard stochastic processes (( r ) r as 
a trader's execution strategies. The value of ( r means instantaneous sales (in other words, 
execution speed) at time r. 

As for the continuity of V t (w, if, s; u), we have the following theorem. 

Theorem 2. Let u G C. 

(i) If h(oo) = 00, then V t (w, <p, s; u) is continuous in (t, w, <p, s) G [0, 1] X D. 

(ii) Ifh{po) < 00, then V t (w, <p, s; u) is continuous in (t, w, <p, s) G (0, ljxD and V t (w, cp, s; u) 
converges to Ju(w,<p,s) uniformly on any compact subset of D as t [ 0, where 

{. 1 _ -h{oa)ip v 

sup u(w + — 8,ip-il),ae- h{ P°W\ (h(oo) > 0) 

sup u(w + ips, (f — ip, s) (h(oo) — 0). 
«/>e[o,y>] 
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As you can see, the continuity in t at the origin is according to the state of the function h 
at the infinity point. When h(oo) < oo, the value function is not always continuous at t — 
and has the right limit Ju(w, tp, s). Ju(w, ip, s) implies the utility of the execution of a trader 
who sells a part of the shares of a security ip by dividing infinitely in infinitely short time 
(enough to neglect the fluctuation of the price of a security) and makes the amount tp — tp 
remain. We will show Theorem [5] in Section 17.51 

Next we study the semi-group property (Bellman principle) of the family of non-linear 
operators corresponding with the continuous-time value function. We define an operator 
Qt : C — > C by Q t u{w,tp,s) = V t {w,tp, s;u). Using Theorem [2] and Lemma [6] in Section [7TT1 
we easily see that Q t is well-defined. Then we have the following. 

Theorem 3. For each r, t G [0, 1] with t + r < 1, (w, tp,s) G D and u G C it holds that 
Q t+r u(w, tp, s) = Q t Q r u{w, tp, s) . 

The proof is in Section 17.41 By using Theorem [3j we can characterize the continuous-time 
value function as a viscosity solution of the corresponding Hamilton- Jacobi-Bellman equation 
(HJB). We define a function F : 5? — > [— oo, oo) by 

F(z,p,X) = - sup < \d-(z s ) 2 X ss + b(z s )p s + ( (z s p w - p v ) - g(()z s p 

where — U x R 3 x S 3 , U — D \ dD, S 3 is the space of symmetric matrices in IR 3 ® IR 3 and 

X ww X wt p X Wi 

z v | G D, p = | Pip | G M 3 , X = ( X vw X w X vs 

-X-sw X SL p X ss 

Although the function F may take — oo, we can define a viscosity solution of the following 
Hamilton- Jacobi-Bellman equation (HJB) as usual : 

d 

—v + F(z, Vv, V 2 v) = on (0, 1] x U, (3.2) 

C/ L 

where T> denotes the differential operator with respect to z — (w, tp, s). Here we remark that 
(13.21) is rewritten as 

d 

— v(t, w, tp, s) — swp^f^v(t, w, tp, s) = 0, (t, w, tp, s) G (0, 1] x U, (3.3) 

Ot £>o 




where 



Id 2 d 

^v(t,w,tp,s) = -a(s) 2 —v(t,w,tp,s) + b(s)—v(t,w,tp,s) 



( d d \ d 

+( [ S Q^ v ( t ' w ' V, s) - Q-v(t, w, tp, s)J - g(Qs—v(t, w, tp, s). (3.4) 

Now we introduce the following theorem which will be proved in Section 17.61 
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Theorem 4. Assume h is strictly increasing and h(oo) = oo. Moreover we assume 

hm . n{ V t (w,^ S + e;u)-V t (w^,s;u) >0 
sio e 

for any t G (0, 1] and (w, <p, s) G U . Then V t (w, tp, s; u) is a viscosity solution of 

Finally we give the uniqueness result of viscosity solutions of ( 13. 3j) . 

Theorem 5. Assume that a and b are both Lipschitz continuous. Moreover we assume the 

^( C) 

conditions in TheoremUl and the growth condition liminf — — = 0. If the polynomial growth 

function v : [0,1] x D — > R is a viscosity solution of (jff.ffi and satisfies the following boundary 
conditions 

v(0, w, if, s) = u(w, if, s), (w,ip,s)ED, 
v(t,w,0,s) = E[u(w,0,Z (t;0,s))], (t, w, s) 6 [0,l]xlx [0, oo), (3.6) 
v(t, w, ip, 0) = u(w, ip, 0), (t, w, (p) G [0, 1] x R x [0, $ ], 

then it holds that V t {w, cp, s; u) = v(t, w, <p, s), where 

Z (t; r, s) = exp (Y (t;r, log s)) (s > 0), (s = 0). (3.7) 

The proof is in Section 17.71 In Section 15.21 we will present an example where assumptions 
in Theorem H] and Theorem [5] are fulfilled. 

4 Sell-Out Condition 

In this section we consider the optimal execution problem under the "sell-out condition." A 
trader has a certain shares of a security at the initial time, and he/she must liquidate all 
of them until the time horizon. Then the spaces of admissible strategies are reduced to the 
following : 

A n /°(tp) = lw)i e A n M ; f>P = 4 > A s » = {(C-)r e Mv) ; jf'c-dr = ^ . 

Now we define value functions with the sell-out condition by 

V? so (w,<p,s;U) = sup E[U(W£)], V t so (w, cp, s; U) = sup E[U(W t )] 

for a continuous, non-decreasing and polynomial growth function U : R — ► R. Then we have 
the following theorem. 

Theorem 6. It holds that V^°(w, cp, s; U) = V t (w, cp, s; u), where u(w, cp, s) = U(w). 

Proof. The relation V^°(w, cp, s; U) < Vt(w,ip, s;u) is trivial, so we will show only the as- 
sertion Vf°(w, ip, s; U) > Vt(w,ip,s;u). Take any (( r ) r G At(tp) and let (W r ,tp r , S r ) r = 
Ei(w, tp, s; (( r ) r ). Take any 5 G (0, t). We define an execution strategy (Cr)r G A^°(ip) by 
( s r =( r (re [0,t- 5]), <p t _ s /S{re{t-6,t]). Let(W?,4,S s r ) r =~ 1 (w,tp,s;(( 5 r ) r ). Then we 
have W t _ 5 = W*_ s < W t 5 . Thus we get E[U(W t - S )] < E[U(W t 5 )] < V t so {w,<p,s;U). Letting 

5 i 0, we have E[t/(Wi)] < V t (w, cp, s; U) by using the monotone convergence theorem. Since 
(Cr)r £ At(<p) is arbitrary, we obtain the assertion. ■ 
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By Theorem El we see that the sell-out condition / ( r dr = <p makes no change for the 

Jo 

(value of) value function in continuous-time model. Thus, although the value function in the 
discrete-time model may vary whether the sell-out condition exists or not, in the continuous- 
time model we may not worry about such a condition. 

Moreover we obtain the following theorem which is the similar result of Theorem [TJ 

Theorem 7. For each (u>, <p,s) G D it holds that 

hm V^°(w, if, s; U) = V t so (w, <p, s; U) (= V t (w, <p, s; U).) 

Proof. We may assume t > 0. It is easy to see that for large n 

V^w^^-u) < V$°(w,<p,8;U) < Vfa(w,<p,s;u). (4.1) 
By the similar arguments in the proof of Theorem [Tj, we get 

lim V [ r ^ t] _ 1 (w,(p,s;u) = V t -(w 1 ip J s;u), lim V£ t] (w, ip, s; u) = V t (w, ip, s; u). (4.2) 

By (14. ip . (j4.2p and Theorem [SJ we get the assertion. ■ 

5 Examples 

In this section we consider two examples of our model. Let b(x) = — [i and cr{x) = a for some 
constants /x, a > and suppose jl = // — cr 2 /2 > 0. We assume that a trader has a risk-neutral 
utility function u(w,ip,s) = w. We remark that we can replace the stochastic control problem 
Vt(w, tp, s; u) with the deterministic control problem f(t, ip), where 

f(t,<p) = sup / Cr exp ( -fir - / g(( v )dv)dr, 

(( r ) r eAt cc ( V )J0 \ JO J 

At ec (<p) = {(Cr)r e ^(v 9 ) ; (Cr)r is deterministic}. 
Indeed we have the following. 

Proposition 1. It holds that V t (w, cp, s;u) = w + sf(t, ip). 

d 

This is proved in Section EH By Proposition [1], we see that — V t (w,<p, s) = f(t,ip) > 
for t, <p > 0. 

5.1 Log-Linear Impact 

Let (a n )nGN C (0, oo) be a sequence which has a limit a G (0, oo) as n — > oo and let <? n (^>) = 
Then the condition [A] is satisfied with = a (and thus g'(C) = aQ. We have the 
following. 
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Theorem 8. It holds that 



1 — e~ aip 

V t (w,ip,s;u) = w H s (5.1) 

a 

for each t G (0, 1] and (w, <p,s) G D. 

The proof is in Section[7]9l We notice that the right-hand side of (15. ip is equal to Ju(w, ip, s) 
and converges to w + (ps as a [ 0, which is the profit gained by choosing the execution strategy 
of so-called block liquidation such that a trader sells all shares <p at t = when there is no 
market impact. Theorem [8] implies that the optimal strategy in this case is to execute all 
shares dividing infinitely in infinitely short time at t = 0. This is almost the same as a block 
liquidation at the initial time, and a trader does not delay the execution time (although MI 
lowers the profit of the execution.) Therefore we cannot see the essential influence of the MI 
in this example. 



5.2 Log-Quadratic Impact 

In this subsection we consider the case of strictly convex MI function. Let (a n ) ng N C (0, oo) 
be a sequence and g n (ip) = a n ip 2 . We suppose lim \a n — na\ = for some a G (0, oo). 

n— *oo 

Then the condition [A] is satisfied with h(Q = 2a( and g(() = a( 2 . We remark that the 
continuous-time value function in this example is the unique viscosity solution of (13. 2p with 
boundary conditions (13.61) . 

Now we extend the set of admissible strategies such that 

o<r<t ', (^v)r-adapted, Cr > 0, / ( r dr < (p 

Jo 

and sup Cr(^) < oo for all e G (0,£)}. 

(r,u/)e[0,t-e]xfi 

We easily see that the value of Vt(w, <p, s; u) does not change by replacing At(<p) with At(<p)- 
We define functions v l (t, w, <p, s) and Q, i = 1,2, by 



sy/l — e - x / ji 



v 1 (t,w,tp,s)=w-\ = — , Ct 1 



and 



v 2 (t 1 w,<p,s)=w + ^=(l-e- Wa ^) 1 C=\/-l rn r-Fi(0- 



Then we have the following. 
Theorem 9. 



arctanhVl — e~ 2flt . \ ~i/ 

(i) Ij ■==, < tp, then Vt(w,(p,s]u) = v (t,w,(p,s) and the optimal strategy is 

given by (Q) r . 

(ii) If tp < \ ~t> then Vt(w, ip, s; u) = v 2 (t, w, <p, s) and the optimal strategy is given by ((~) r - 

V a 



S 



Proof. Let (W*, (p % r , §l) r = E t (w,ip,s;(Q) r ) for i = 1,2. The straight calculation shows 
that E[W7] = v*(t,w,<p,s). Then we have v l (t,w,ip, s) < Vt(w,<p, s;u). The inequality 
v l (t,w,<p,s) > Vt(w,(p,s]u) is obtained by the similar arguments in the proof of Theorem 
5.2.1 in [19]. ■ 



This theorem implies that the form of optimal strategies and value functions vary according 
to the amount of the security holdings ip. If a trader has a little amount of securities, then we 
have the case (ii) and the optimal strategy is to sell up the entire shares of the security until 



the time \ — t. If he/she has so large amount, then we have the case (i) and a trader cannot 
V a 

finish the selling. 

We have not had the explicit form of V t (w, <p, s; u) on a whole space. So we try to solve 

this example numerically. V±(w,<p, s;u) is approximated by V™(w, <p, s; u) for enough large 

n, and we can assume that the optimal strategy is deterministic. We can get the value of 

V™(w,ip, s;u) numerically by the computer when n is not so large. Figure Q] describes the 

form of execution strategies and Figure [2] describes the form of corresponding processes of 

the amount of a security when we set n = 500, w = 0, s = 0, a = 0.01, jl = 0.05, a = and 

ip = 1, 10 and 100. We also get the form of the function f(t,(f) of Proposition [T] numerically, 

which is described in Figure El If a pair (t, </?) is in the range (a) of Figure HI then we have 

y/\ _ e -2jit i 
f(t, ip) = -== — , and if (t, ip) is in the range (c), we have f(t, ip) 



We have not had the form of f(t, if) analytically when (t, if) is in the range (b). 



OWN 
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Figure 1: The forms of optimal execution strategies (Cr)r- Circle-marked dotted lines mean 
numerical solutions, and solid lines mean analytical solutions. Horizontal axes are time r. The 
left graph : tp = 1. The middle graph : tp — 10. The right graph : ip = 100. 



6 Concluding Remarks 

In this paper we study the optimal execution problem in consideration of MI. First we formu- 
late the discrete-time model and then take the limit. We show that the discrete-time value 
functions converge to the continuous-time value function. 

We mainly treat the case when MI function is convex. This is not only from the math- 
ematical reason, but also from the financial viewpoint. In a Black-Scholes type market, an 
optimal execution strategy of a risk-neutral trader is a block liquidation when there is no MI. 
The form of the optimal strategy entirely changes when MI is quadratic. When MI is not 
convex, especially linear, then a trader's optimal strategy is almost block liquidation. 
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Figure 2: The forms of the amount of a security holding (p r ) r corresponding with optimal 
strategies. Horizontal axes are time r. The left graph : ip = 1. The middle graph : <p — 10. 
The right graph : p = 100. 




Figure 3: The form of the function f(t, if). 

But in the real market, many traders execute the selling in taking time in spite of recog- 
nizing that the MI is concave. We surmise that one of the reasons is that MI can be divided 
into two parts : permanent impact and temporary impact (see [2] and [§].) As time passes, 
the temporary impact disappears and the price once pushed down transitorily is recovered. 
Our examples treat permanent impact only, but we can also consider temporary impact and 
price recovery effects. If the process of security prices follows some mean-reverting process, 
like Ornstein-Uhlenbeck process, then we may deal with the optimization problem with MI 
and price recovery. Studying this case is one of our further developments. 

It is also meaningful to characterize the continuous-time value function as the solution 
of corresponding HJB. We have shown that the value function is a viscosity solution un- 
der some strong assumptions. Such assumptions are not necessary when we consider only 
bounded strategies. But since the control region of our model is unbounded, we should argue 
deliberately about whether F > — oo or not. 

In trading operations, a trader should execute while considering the fluctuation of the 
price of other assets (e.g. the rebalance of an index fund.) [TU] studied the multi-dimensional 
version of this model to consider such a case. But in the case of rebalancing, it is necessary to 
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consider not only selling but also buying the securities. We should formulate such a model of 
an optimal execution problem carefully with avoiding the opportunity of free-lunch when MI 
is large. 

The complete solution of our example in Section 15.21 is another remaining task. This is a 
representative example where an trading policy is influenced vastly by MI, and will be pleasant 
to solve completely in future researches. 



7 Proofs 

7.1 Preliminaries 

We introduce some lemmas which we use to prove our main results. 

Lemma 1. For each m G N there is a constant C > depending only on b, o and m such that 
E[Z(s) m ] < Cs m , where Z{s) = sup Z(t;0,s). 

0<t<l 

Proof. We may assume s > 0. The boundedness of a and b implies 



E[Z(s) m ] < C s m E \ sup e(m [ a(Y(r; 0, log s))dB r 
Ue[o,i] ^ Jo 



for some Cq > 0, where e(M) t = exp(M t — (M} t /2) and ((M) t )t is a quadratic variation 
process of a martingale M = (M t )t- Then Corollary 2.5.10 in [16] gives the assertion. ■ 

Lemma 2. Let T k , k G N, be sets, u G C and (W^k, 7), (p\k, 7), S^k, 7)) G D, 7 G T k , 
k G N, i — 1,2, be random variables. Suppose 

lim sup Efl^ 1 ^^) - W\k^)\ + 1^,7) - <^ 2 (£;,7)| + \S\k,j) - S 2 (k^)\] = 
fc^oo 7erfe 

2 

and V sup sup E[(W(k, 7)) 2m " + {S\k, 7)) 2mu ] < 00. Then it holds that 
~^ fceN 7 er fe 

hm snp\EHW\k, 1 ),^(k, 1 ),S\k, 1 ))]-EHW 2 (k, 1 ),^(k, 1 ),S 2 (k, 1 ))]\=0. 

fc^oc 7erfc 

This lemma is obtained by the standard arguments using the Chebyshev inequality and the 
uniform continuity of u(w, if, s) on Dr for any R > 0, where Dr = [-R, R] x [0, $0] x [0, R}. 

Lemma 3. Let < to < ■ ■ ■ < tf. < 1 and f : [0, 1] — > [0, 00) be a Borel measurable function. 
Suppose that f is continuous on [0, 1] \ {to, • • - tk} and there are a Borel measurable function 
7 : [0, 1] — > [0, 00) and a constant (3 > such that 

f(t)<i(t)+P [ f(r)dr, t e [0,1]. (7.1) 
Jo 

Then it holds that 

f{t)<l{t)+(3 [\(r)e^dr, t G [0, 1]. (7.2) 
Jo 



11 



Lemma [3] is obtained by using the same arguments in the proof of the Gronwall inequality 
to /(£) on [0, t{\ inductively in I. 

Using the Burkholder-Davis-Gundy inequality and the Holder inequality, we have the fol- 
lowing lemma. 

Lemma 4. Let £ £ [0, 1], <p > 0, x £ R, (( r )o<r<t £ -Atd-p) an d let (X r ) < r < t be given by i \2M 
with Xq = x. Then there is a constant C > depending only on b and a such that 



E 


sup 


X r - X ro + / g(Qdv 


4- 


<C(n 




L re[ro,ri] 


Jr 







for each < ro < r\ < t. 

Lemma 5. Let t £ [0,1], <p > 0, x £ R, (C r )o<r<t, (C)o<r<t G A(y?) ^£ (^r)o<r<t 
(respectively, (X' r ) < r < t ) be given by i \2.6b with (Cr)r (respectively, (C r ) r ) and X = x < X' Q . 
Suppose ( r < (' r for each r £ [0, t] almost surely. Then it holds that X r > X' r for each r £ [0, t] 
almost surely. In particular we have exp(X r ) < Z(e x ). 

This lemma is obtained by the same arguments as in the proof of Proposition 5.2.18 in 
[TT] . Lemma Q] and Lemma [5] imply the following. 

Lemma 6. For n £ R, k — 0, . . . , n, ££[0,1] and u £ C, V^(w, <p, s; u) and V t (w, <p, s; u) 
are non- decreasing and polynomial growth in w, ip and s. 

By the standard arguments, we obtain the following. 

Lemma 7. Let 

q n (w, ip, s, ip; u) = E[u(w + (ip A ^e -9 "^^ , tp - (ip A <p), Z(l/n; 0, se" 9 "^^))] 
for u £ C, where a Ab = min{a, b}. Then q n is continuous on D x [0, $o]- 

We remark that Vi(w, <p, s; u) = sup q n (w,p,s,ip;u). By Lemma El Lemma [7] and the 

^e[o,* ] 

arguments of the Bellman equation in discrete-time dynamic programming theory (see [1]), it 
holds that V£(-;u) £ C. 

7.2 Proof of Theorem d 

We divide the proof of Theorem [1] into the following two propositions. 
Proposition 2. limsup V£Jw, ip, s; u) < V t (w,ip, s;u). 

Proof. For brevity, we suppose £ = 1. For u' £ C and (w',ip',s') £ D, let ip n (w' , tp' , s' ; u') be 
an optimal strategy for the value function V™(w' , ip' , s'; u'). By Proposition 7.33 in [1], we can 
take ip n (w' ' , ip', s'; u') as a measurable function with respect to w', ip' and s'. 

We define G and Sflk, by (W?,^,^) = («;,¥»,*), VP = 

^ n (H/ / n ,^,^ n ;\/-/-i( ■ ; «)) A p?, (ED and (Q inductively in I and let = logS, n . 
We also define a strategy (Cr)o<r<i by £ r = nip? nr y Then it holds that (( r ) r £ (</?). Let 
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(W r ,</V,^r)o<r<l = Ef(w,lf,S] (Cr)r)- 

iSfep 1. First we show that there are a constant C* > and a sequence (c*) n£ N C (0, oo) with 
c* n /n — > as n — > oo such that 

9»W) < C* A (c^D, / = 0, . . . ,n - 1. (7.4) 
If lim < oo, the assertion is obvious. So we may assume h(oo) = oo. Let f n {^) = 

>oo 

jp—g n (i/j) and p n (^) = ^e"^ for ip e [0, $„]■ Then we have -ryp n (i(>) = e~ 9reW,) (l - / n (V0)- 

Co u/ Ci ID 

We define a set A n as A n = e (0, <J> ] j /nC0) = !}■ By [A] and the assumption h(oo) = oo, 
we see that A n is not empty and the function p n {ip) has a maximum at one of the points in 
A n for enough large n. We denote by ^* the supremum of A n , and by the point at which 
Pn{^) has a maximum. 

We see that the function u(w, <p, s) is non- decreasing in (w, <p, s), p n (ip) < Pn(i>n) holds for 
ip G (^*,$o] an d Lemma [5] implies that r;x) is non-increasing with respect to x. Thus 
ip n {w, <f, s; u) < ipn for large n. Then, by the definition of we get 

< < < C / = 0, . . . ,n - 1, n > n (7.5) 

for some no G N. Moreover [A] implies 

nipn — ► oo, n — > oo. (7.6) 

Indeed, if (17. 6ft does not hold, there are a constant M > and a subsequence (n^)* C N such 
that Ukipn k — M. Then we have 

n k = n k fnMn k ) < n k r n M n ^n k ) + £ 'n k )< M(h(M) + e'J 
dg r , 



for each k, where e' n = sup 



. This is a contradiction. 



Since h(Q is non-decreasing, we have 



9nW< f{h{n^)+e' n W< [\h(nr n )+e' n W 
Jo Jo 

- (^ 9nirn) + 2e ' n )^ = (^ + 2£ ' n )^^ ^e[0,C] (7-7) 

for each n£N. Thus 

^(^)<l + 2$ sup4„ Ve[0,<]. (7.8) 

n' 

By (17. 5p . (17. 6p . (17. 7p and (17.81) . we have the assertion by letting 

C* = max£ n ($ ) + 1 + 2$ sup e' n , c* n = — + 2 £ ' n . 

Step 2. In this step we will show that 

lim E[ max \X% - X k/n \ 2 ] = 0. (7.9) 

n^oo k=0,...,n 
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We define X r n , r e [0,1], by 



k 



I r " = yr;-I[-s„«) re 



fc fc + 1 



n n 



(7.10) 



and Xq = log s. Then we see that Iu n = X£ for each fc = 0, . . . , n and that X™ satisfies 

X? = \ogs+ a(X:)dB v + biX^dv-J^M), 
Jo Jo k=0 



where c n {r) = [nr] — \z + {nr) and Qni^k) = 0- 

1 



k=0 



Let A™ = E max \ \X n r , - X r ,\ 2 ; r' = 0, ^ 



) • ■ • ) 5 

n n 



Then we get 



Cn(r ) „ r > n-1 . 

E*-/ »(C)d«| < ^|^(0--^(nC)|+^(r)^(^ nT] ) 

fc=0 ^° fc=0 

for r' = 0, — , . . . , , r, where d n (r) = c n (r) + 1 — nr. Then Step 1 implies 

n n 



\X? - X r ,\ 2 < 4 / (<r(X v ) - <r(X»))dB v 



(b(x v ) - b{x:))dv 



n—1 , 2 

E M« - -£M?)|) + <ar)V(^ r] ) 2 



< 4{ sup / 

L 0<v<r Jo 



k=0 



0<v<r 



{a{X v ,) - a {X%))dB v , 



+ sup 

0<v<r 



{b{X v ,)-b{X%))dv' 



for r' = 0, — , . . . , , r, where e n is defined by ( 12. Eh . Thus, using the Burkholder-Davis- 

n n 

Gundy inequality and the Holder inequality, we have 



A™ < C | 7 n(r) + E [j \X V - X v \ 2 dv\ ) < C ( 7 n(r) + J A> 

for some constant Co > 0, where 7„(r) = $o £ n + C*c* n d n (r) 2 E[^C P ]]- Then Lemma [3] implies 

A? < Coin(r) + C 2 f ln (v)e Co ^dv. 

Jo 

Since < < 1 for ^ e [0, 1] and d n (l) = 0, we have 

E[max \Xl-X k/n \ 2 } = /X r l<C l Ule 2 n + [ j n (v)dv\ 

k=0,...,n v. Jq ) 

< C 1 {2$^ + ^E E ^]}^^{ 2$ o4 + ^ 2 ^} (7.11) 
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for some C\ > 0. By (12.51) and the assertion of Step 1, the right-hand side of (17. lip tends to 
zero as n — > oo. Then we have ( 17.91) . 

n-l r {l+l)/n 



Step 3. Let W% = w + J^ 



ni\)™ exp(X™ — (nr — tygnfy^^dr. By the following relation 



l/n 



e v \ < 



e rx e 



^ y dv\x -y\< (e x + l)(e v + l)\x- y\, 



(7.12) 



it follows that 



n-l 



1=0 



(l+l)/n 

l/n 
n-l 



{ exppff - (nr - l)g n {^)) - exp(X r )}dr 



< 



(Z(s) + l) 2 V^ ; max \X?-(nr-l)g n {W)-X r \dr. 

' (=0,...,n— 1 



Z=0 



Since 



\X[ l -(nr-l)g n (^)-X r \ < X r -X l/n + g(Qdv + \X? - X l/n \ + (nr - l)e n ^ 

Jl/n 

for each I — 0, . . . , n — 1 and r e [//n, (/ + l)/n], by virtue of Lemma HI it holds that 
E[ max sup \X? - (nr - l)g n W) - X r \ 2 } 1/2 

l =°="> n - 1 re[l/n,(l+l)/n} 



n-l 
1=0 

< C x 



sup 


X r - X l/n + / g(Qdv 


4- 


L re[V™,(/+l)/n] 


J l/n 





1 V4 

j + 5 n + $ £r 



1/4 



+ 5 n + $ £ n 



for some C > 0, where <5 n = E[ max \X% — X fc / n | 2 ] 1//2 . Thus 

k=0,...,n 

E[\W: -Wi\]< * E[(Z(s) + l) 4 ] 1/2 5„ < Cj n 

for some C\ > 0, where S n is a right-hand side of (I7.13p . 
On the other hand we have 

E[|^ - exppfOI] < E[(Z(s) + 1) 4 ] 1/2 E[\X n n - X^ 2 ] 1 ' 2 < C 2 5 n 



(7.13) 



(7.14) 



(7.15) 



for some C 2 > 0. Since Step 2 implies that 5 n and 5 n converge to zero as n — > oo, by (I7.14p . 
( I7.15P and Lemma we can apply Lemma [2] and then we obtain 

hm \ E[u(W:,^S:)}-E[u(W 1 ,^ 1 ,ex V (X 1 ))]\=0. (7.16) 

Since u is non-decreasing in iu and the relation W™ > W^™ holds, we have 

CK ¥>, s; u) - 14 (w, if, s; u) < E[u(W^, ^, £%)] - E[u(Wi, </?i, exp(Xi))] 

< EKT^,^,^)] -E^lf^Lexp^))]. (7.17) 

(17. 161) and ( 17.171) imply the assertion of Proposition [2] ■ 
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Proposition 3. liminf V£ t Aw, cp, s; u) > V t (w,ip,s;u). 

n—*oo ' ' 

rl/n 

Proof. For brevity we suppose t = 1. Take any (Cr)o<r<i £ -^(v 9 ) and let ^ = / Cr 

J((i-i)Mvo 



dr. 



'((Z-l)/ra)V0 



where aV6 = max{a, 6}. Then we have (^ n )z € vA™(yj). Let (W r , y2 r , -^r)o<r<i = (w, tp, s; (C r ) r ), 
(W?, tf, S?)t = S>, <p, s; and X? = log SJ». 



S'iep 1. First we will show that 



E[ max \XJ*-X k/n \ 

k=0,...,n 



0, n — > OO. 



(7.18) 



Define X™ by (17.101) and let A" = E[ sup — X r /| 2 ]. By the similar calculation in the 

0<r'<r 

proof of Step 2 of Proposition [2} we get E[ max \X% — X k / n \ 2 } < A" < Coz n for some Co > 

fc=0,...,n 

M 2 

7l 2 



depending only on b and a, where z n = $o £ n "I |f + E / \G n (v)\ 2 dv , M = g(supCr(^)) 

W L Jo J r,aj 

y([ni;]+l)/n . 

and G n (v) = gin / Cu'^'J — fl'(Cu)- Here |G n (r, o;)| < 2M holds and Lebesgue's 

^ J[nv]/n ' 

differentiation theorem implies G n (v,u) — > as n — > oo for almost all (i>, cu) G [0,1] x Q. 
Then, using the dominated convergence theorem, we have z n — > as n — > oo. Then we 
obtain (17381) . 

i-l p(l+l)/n 

Step 2. Let VT" = w + 2,i ; ? n / exp(X r )(ir. Then we have 

J l In 



E[\W?-W X \] 

n-2 r (l+l)/n 



< 



1=0 



l/n 



(i+l)/n 



exp(X r+ i /n )n / C^rfw - exp(X r )Cr 



'/" 



+ E 



exp(X r )( r dr 



(n-l)/n 



< 



Co{<K E[ sup |X 1)+1/n -X 1 ,| 2 ] 1 / 2 + ( / E[|i/„(r)|Vr) 1/2 + 

ue[0,l-l/n] Wo ' 



1/2 1 

n 



for some Co > depending only on b, a, (( r )r and s, where H n (r) = n 
Lemma HI we have 

E[ sup \X v+1/n - X v \ 2 ] 1/2 < C 2 x -L + — 



([nr]+l)/n 



C^dv-Cr- By 



nr]/n 



i;e[0,l-l/n] 



n n 



for some C2 > 0. Moreover, Lebesgue's differentiation theorem and the dominated convergence 

theorem implies / E[|-ffn(V)| 2 ]^ r — > 0, n — > 00. Then we obtain EUW 7 "™ — Wi|] — > 0. 
Jo 

On the other hand, the similar calculation in Step 2 of the proof of Proposition [2] implies 
E[\W£ - W?\] — ► 0. Thus the convergence E[|W£ - W?\] — ► holds. 

By ( 17.181) . we have E[\S™ — exp(Xi)|] — ► 0. Then we can apply Lemma [2] and we get 

EHWu^eMXi))} = I™ E[u(W^ <p», < liminf V£{w, tp, s;u). 



16 



Since (Cr)r £ •^■i{ i P) is arbitrary, we obtain the assertion. 

By Proposition [5] and Proposition [31 we obtain Theorem HJ 



7.3 Strategy-Restricted Value Functions 

In this subsection we prepare the strategy-restricted value functions to prove Theorem [2] and 
Theorem [HI For L > 0, we define 

A n k ' L &) = {M~oeA n M ; ^<L/n, J = 0,...,*-1}, 
A L 0) = {(Cr)o<r<t e AO) ; sup < L}, 

V k ^ L (w,^s;u) = sup E[«(WT,^,5J)], 

V t L (w,tp, s;u) = sup EKW t ,¥> t ,iSt)]. 

Easily we see V^io, s; it) = sup V£' (w, <p, s; it) and Vt(u>, y?, s; u) = sup V^ L (io, y?, s; it). By 

L >0 L>0 

the similar argumets in Section 17.21 we see that for each L > 0, (it), ip, s) £ D, t £ [0, 1] and 
u e C 

lim ^rntf ( w > V 9 ' s ; M ) = ^ L ( w ' <P> s; it). (7.19) 

Now we consider the continuity of V t L (w,ip,s;u). Our purpose in this section is to prove 
the following proposition. 

Proposition 4. V t L (w, y?, s; it) is continuous with respect to (t,w,ip,s) G [0,1] x D. 

To prove Proposition HI we will show the following lemmas. 
Lemma 8. For each (w, <p,s) G D and t G [0, 1] it holds that 

lim sup \V t L (w',<p',s';u) - V t L (w,p, s;u)\ = 0. 

(w',ip',s')-*{w,ip,8) L>0 

Proof. Let R > and <p, s), (it/, <p', s') G Dr. We may assume s' > 0. Take any (( r )r<t G 

A L 0)- Let p = inf{r > ; / ( r > <p A A t and £ = C4{r< P }- Then (£) r < t G A L (<A 

Jo 

Let (W r , <£y, S' r ) r <t = Z t (w,<p, s; (Cr)r) and (W^, ^, ^) r < i = S t (io', <£>', s'; (Or)- Moreover let 
us define (S' r ) r <t by 

= &(S' r )dB r + b(S' r )dr — g(( r )S' r dr, S' = s'. 
Then Lemma [5] implies S' r > S' r for each r G [0, i] almost surely. Thus 

E[u(W t , <pt, S t )] - V t (w', <?', s'; u) < E[|u(Wi, ^, $) - u(W' t) <p' t , S' t ) |]. (7.20) 
By the simple calculation we get 

\W t -W;\ < (Z(s) + l){\w-w'\ + \<p-<p'\+® sup \s r -s' r \} 

re[0,t] 
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and \if t — if' t \ < \ip — if'\. Moreover Theorem 3.2.7 in [TH] and Lemma [T] imply 

E[SU P l^-^O < ( C n ° S ' . { ( S Zn[ 

re[o,t] I Col log s - logs I > 0) 

for some Cq > depending only on b, a and i?. Then we obtain 

sup sup E[\u{W u <pt,S t )-u{Wl,<f/ t ,S't)\]^>Q (7-21) 

as (it/, 9?', s') — > (w,ip,s) by using Lemma [21 (I7.20p and (I7.2ip imply 

lim sup(^ L (w, if, s; it) - V t L (it/, if', s'; it)) < 0. 

{w',<p',s')-*(w,<p,s) L>0 

Similar argument gives us 



lim sup(V t L (w', if', s'; it) - V^io, s; it)) < 0. 

(w',tp',s')-y(w,tp,s) l>0 

So we get the assertions. ■ 

By Proposition HI it follows that the convergence of (17.191) is uniform on any compact 
subset of D for each fixed t (we remark that V t L (w, if, s; u) is non-decreasing in w, if and s.) 
Moreover, by Lemma [61 we see V t (■; u) £ C and V t (-; u) £ C. 

Lemma 9. For each compact set E C D it holds that 

limsupsup sup (V r L (w, if, s; u) — V t L (w, if, s; it)) < 0, t £ (0,1], 

r]t L>0 (w,<p,s)eE 

limsupsup sup (V r L (w, if, s; u) — V t L (w, if, s; it)) < 0, r G [0,1). 

tlr L>0 (w,ip,s)eE 

Proof. Let r,t 6 [0, 1] with r < t. Then Lemma H] and Lemma [2] imply 

sup sup sup E[\u(W r ,ip r ,exp(X r ))} - u(W t ,<f t ,exp(X t ))\] — >0 



asr 1 1 and t [r, where (W v , <p v ,X v )o< v < r = Sf (if, V 3 , s ; (C-)r), 
(W,;,^,!^^ = Sf (w,<f, s; (Cr)r) and = C4[o,r](^)- This implies the a 

Similar arguments give us the following lemma. 
Lemma 10. For each L > and compact set E C D it holds that 

limsup sup (V t L (w,if,s;u) — V T L (w,if,s;u))<0, t G (0,1], 
r-Tt (w,tp,s)eE 

limsup sup (V t L (w, if, s; u) — V r L (w, if, s; it)) < 0, re [0,1). 

t]r (w,Lp,s)eE 

By Lemma ISlfTUl we obtain Proposition [H 
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7.4 Proof of Theorem [3] 



In order to show Theorem [31 we further define operators Q t : C — > C and Q™' : C — ► C by 
Qtii(w, <f, s) = V t L (w, <p, s; u) and Q^' L u(w, <p, s) = V^ n ^u(w, <p, s). We see that operators Q\ 
and Qt' L are also well-defined. First we will show 

Q^.u{w, f, S) = QtQrUiw, if, s) (7.22) 

for each t,r E I with t + r <1, where / = {k/2 l ; k, I G Z + } n [0, 1], and Z + = N U {0}. Let 
n 6 Nbe large enough to 2 n t,2 n r G Z + . By the Bellman equation of the discrete-time case 
([!]), we have 

Qt+ r u(w, tp, s) = Qt' L Qr' L u(w, <p, s). (7.23) 

By the arguments in Section 17.31 letting n — * oo at (17.23p . we get ( 17.22ft for each t,r G /. 
Using Proposition HI we see that (I7.22p also holds for each t,r G [0, 1]. 

Now Theorem [H]is obtained by the relation Q t u(w, if, s) = sup Q^u(w, </?, s) and the similar 

L>0 

calculation in the proof of Proposition 4 in [20] • 
7.5 Proof of Theorem [2] 

In this section we give the proof of Theorem [2j First we consider the right-continuity at t = 
in the case of h(oo) = oo. 

Lemma 11. Assume h(oo) = oo. T/ien for each t G [0, 1] and {( r )o<r<t G *4.i(y?) it ZioWs t/iat 

ex P ( - J g((v')dv'^)( v dv < 0(r), r G [0,t], 

where 4>(r), r G (0, 1], is a continuous function depending only on the function h(() and $o 
such that lim0(r) = 0. 

r—*0 

pr 

Proof. Let n r = g(( v )dv and tr = mi{v G [r/2, r] ; ^ > /?} A r for r G (0, t] and i? > 0. 
Then we have 

/ exp(— ir v )( v dv < / ( v dv + / e~ R ( v dv < / Ccfo; + ^oe^ 
Jo Jo Jt r Jo 

for r G (0,t] and i? > 0. Since g(() is convex, the Jensen inequality implies 



< rjtf"^ ^ 0(Ct*«)*>) < r 9~ 1 (-J o 9(Cv)dv) < rg^(2R/r), 

where g~ 1 (y) = inf{C G [0, oo) ; (7(C) = y}, 2/ > 0. g~ 1 (y) is defined at any y > and 
continuous for large y since fa(oo) = 00. 

Let us define a function /(C), C > 0, by /(C) = C\A(C/2). Then /(C) is continuous, 
strictly increasing for large y and satisfies /(0) = and lim /(C) = 00. Thus /(C) has a 

f— »tX3 
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continuous inverse function / 1 (y) on [0, oo) such that / 1 (0) = 0, lim / 1 {y) = oo and 

f~ 1 {y) is continuous for large y. So we can define M(r) = / _1 (l/r) and R(r) = rg(M(r))/2 
for r G (0, 1]. Then we see that M(r) — > oo as r — > and that 



R(r) > 



M W > rM(r)fc(M(r)/2) = y/h(M(r)/2) 

M(r)/2 4 4 



OO 



as r — > 0. Moreover we have 

rg~ l (2R(r)/r) = rM(r 



0, r^0. 



Vfc(M(r)/2) 

Then the assertion holds by letting 0(r) = rg~ 1 {2R{r) /r) + $o ex P( — R( r ))- ' 

Proposition 5. Assume h(oo) = oo. T/ien /or eac/i compact set E d D it holds that 
lim sup |Vt(u;, s; u) — u(w, <p, s)\ — 0. 

Proof. Take any t G (0, 1). Then we have 

V t {w,<p, s;u) - u(w,cp, s) < sup | E[u(Wt,<pt,S t )] - E[u(w,<p t , S t )]\ (7.24) 

(Cr)rGA(^) 



by virtue of the relations ipt < and St < s, where St = sexp y~j d(Cv)dvj and 

(W r , y? r , 5'r)o<r<t = ^t( w , V 9 ; s j (Cr)r)- Using Lemma [TTj the Burkholder-Davis-Gundy inequal- 
ity and the Holder inequality, we have 



E\\W t -w\} < sE 



exp 



L J0 



g((v)dv)( r dr 



E 



\S r - S r \( r dr] < s<p{t) + C $ t 1/2 



'-jo 



for some Cq > which is independent of (Cr)r- Then, by (I7.24p and Lemma El we get 

limsup sup (Vt(w,cp,s;u) — u(w,ip,s)) < 0. The inequality limsup sup (u(w,ip,s) — 
tj.o (w,<p,s)eE tj.o (w,<p,s)eE 

Vt(iy, s; u)) < is obtained by Lemma [HI Then we have the assertion. ■ 

Next we consider the case of h(oo) < oo. 

Proposition 6. Assume h(oo) < oo. Then for each compact set E C D it holds that 
limsup sup (Vt(w, <p, s; u) — Ju(w, <p, s)) < 0. 

Proof. Take any t G (0, 1) and (Cr)o<r<t e A(y?)- Let (W r ,(p r ,X r )o< r < t = E?(w,ip,s; (Cr)r)- 
Easily we have 



lim sup sup 



E[u(Wi, <£>t, 5*)] — E u[w + s e ^(rdr, <p-r) t ,se 



(7.25) 



by virtue of Lemma El where r\ r 



( v dv and ?7 r 
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g(Cv)dv. 



Now we define fj r = l(o,t](0 / h((/ r )d( and w t = exp ( — / h((/t)d()dp. Since 

g(Q is convex, the Jensen inequality implies fj r > rg(rj r /r) = r) r for r G (0, £]. Moreover /i(£) 
is non-decreasing in ( and so is </?, s) in w. Thus we get 



E u(w + s y e ^(rdr,^ — r] t ,se *j < E[w(w + si&t, — 7/t, se *)] 

for each (£ r ) r G At(f)- By this inequality and (17.251) . we get 
limsup sup (Vt(w, <f, s; u) 

UO (w,<p,s)eE 

— sup E[u(w + sw t , f — Vt, se~ Vt )}) < 0. (7.26) 

(Cr)rSA(v) 

Next let us define e t = / (/i(oo) - h((/t))d(. Then we have |e _ * - e - ft(oo)j?i | < £ t 

and \wt — F{rj t )\ < $o^ ; where -F(^) = / e~ h ^ p dp. The dominated convergence theorem 
implies e t — > as 1 J, 0. e t is independent of (£ r ) r £ ^(v 9 ); so the Lemma [2] implies 

lim sup sup | E[u(w + sw t , ip — T} t , s exp(— r)t))] 
'J- (ie,p,s)e£ (Cr)reA(v) 

- E[«(w + F(rjt)s, <p - m, se- h ^)] \ = 0. 
Using this and (I7.26p . we get the assertion. ■ 

Proposition 7. Assume h(oo) < oo. Then for each compact set E C D it holds that 
limsup sup (Ju(w, <p, s) — V t (w, <p, s; u)) < 0. 

ij.0 (w,tp,s)eE 

Proof. Let t G (0, 1). For each (w, <p, s) G E, take any ip G [0, <p] and define (( r )o<r<t G ^(v 9 ) 

by £ r = — and (W r , tp r , S r ) < r < t = ^t{w, </?, s; (Cr)r)- Similar to the proof of Proposition [6], we 
get 

lim sup sup \u{w + F(ij)s,<p-ip,se- h{o °^) - E[u(W t , <p t , S t )]\ = 0, 
(ui,p,s)e£^g[o,f>] 

which implies our assertion. ■ 
Finally we consider the continuity with respect to t G (0, 1]. 

Proposition 8. For each compact set E C D we have 

(i) lim sup \V t '(w, <p, s; u) — V t (w, <p, s; u)\ = 0, t G (0,1], 
*'T* (w,ip,s)eE 

(ii) lim sup \V t >{w, ip, s; u) — V t (w , <p, s; u)\ = 0, f G (0,1). 

(w,ip,s)£E 
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Proof. Dini's theorem implies that V t L (w, </?, s) converges to V t (w, tp, s) uniformly on any com- 
pact set E C D for each t. Thus, using Lemma 0, we get the assertion (i). 

Next we will check the assertion (ii). If h(oo) = oo, this assertion holds by Proposition [5] 
and Theorem [31 So we may assume /i(oo) < oo. 

By PropositionEHZIand Theorem[3]again, we get lim sup \V t '(w,<p,s;u)—JVt(w,<p,s;u)\ = 

(w,ip,s)eE 

0, and obviously it holds that Vt(w, tp, s; u) < JVt(w,tp, s;u). So it suffices to show that for 
each t G (0, 1) it holds that 



JV t (w, p, s; u) < V t (w, ip, s; u). 



(7.27) 



Let 5 E (0,t). Take any ip e [0,(p] and (Cr)o<r<t £ A t (p — ip). Define (( r )o<r<t £ ^(v 9 ) 

by C r = jl [0 ,«](r) + Cr- Let (W r , p r , X r ) < r < t = Ef{w + F{ip)s,cp- ip, se"^ 00 ^; (C r ) r ) and 

(W 7 ,,, y5 r , X r .) < r < t = H t (w, cp, s; (Cr)r), where F(x) is given in the proof of Proposition [6j Then 
we have for r e [<5, t] 



<r(X„) - a{X v ))dB v + / (6(X„) - b{X v ))dv + e 5 , 



where e s = h(oo)ip - / (g(( v ) - g(( v ))dv 



5 



JO 



( J + Cv 



the Burkholder-Davis-Gundy inequality and the Holder inequality, we get 



E[sup \X V - X v \ 2 } < C \ I E[\X v -X v \ 2 ]dv + E[e s ] 

v£[8,r] 



< C / E[\X V - X v \ 2 }dv + 2 / E[\X V \ 2 + \X v \ 2 ]dv + E[e s ] 



< Ci\ I E[ sup \X V , -X v ,\ 2 ]dv + S + E[e d ] \, re[6,t] 
h v'e[8,v] 



for some Co, C\ > 0. So the Gronwall inequality implies 



E[sup |X r -X r | 2 ] < CA6 + E[e s ] + (S + E[e s }) t e Clit ~ r) dr\ < C 2 (6 + E[e 5 }) 

re[6,t] L J 6 J 



for some C 2 > 0. Since E[es] < - / / (h{oo) — h(('/8))d(' < is — > as 5 | 0, where Eg is 

o Jo Jo 



given in the proof of Proposition [6], we get E[ sup |X r — X r \ 2 ] 

re[S,t] 

exp(Jf r )|] — > as 5 j 0. Moreover we have 



and then E[ sup |exp(X r ) — 

re[0,t] 



E[\W t - W t \] < E 

»<5 



+ E 



exp(X r ) — exp(X r )|£ r dr 



< E 



o 



exp(X r ) — sexp 



h(oo)ipr 
6 



dr 



$o E[ sup | exp(X r ) — exp(X r 

re[0,t] 
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Since 



exp(X r ) — s exp 



h(oo)ifir 
6 



< (Z(s) + r 



X r - logs + / g((v)dv 



+ 



(g{(v) - g((v))dv 



h(oo)if)r 



s 



l{( v )dvj 



for r G [0, 5], we have 

r s 



E 



t 
S J 



exp(X r ) - s exp ^_ M°o)# ^ dr < + E [ e<5 ] + g ^ sup £ r (a;)J 5 j 



for some C3 > 0. Then it follows that E[|Wi — Wt\] — > as 5 J, 0. Thus Lemma [2] implies 

E[u(Wt> </?t, exp(X t ))] - V t (w, (p, s; it) 

< lim\E[u(Wt,<ft,eM^t))}-E[u(Wt,<ft,eM^t))} \ = 0. 
0J.0 

Since (( r ) r E At(<p — if)) is arbitrary, we have 

V t (w + F(iP)s, ip-iP, se- h ^) < V t (w, <p, s; «). 

Since //> G [0, <£>] is arbitrary, we get (17. 27ft . 

By Proposition [3HH1 and the relation V t {- ;u) G C, we complete the proof of Theorem [21 



7.6 Proof of Theorem [4] 

In Section 17751 and Section [7771 we always assume that /i is strictly increasing and h(oo) = 00. 
First we consider the characterization of V t L (w, cp, s; u) as the viscosity solution of the 



corresponding HJB. We define a function F : U x R x S x 

1 



by 



F n (z,p,X,u) = - sup <-a(z s ) X ss + b(z s )p s + C(z s p w -p (p ) - g(()z s p s } . 

0<(<L I * 

Then we have the following. 

Proposition 9. Assume h(oo) = 00. Then, for each u G C, the function V t L (w, </?, s; it) is the 
viscosity solution of 



d 

—v + F L (z,Vv,V 2 v,v)=0 on (0,11x17. 
at 



(7.28) 



Since the control region [0, L] is compact, we obtain Theorem [9] by using (17.221) and the 
similar arguments in the proof of Theorem 5.4.1 in [19] . 

Next we treat HJB (JST2D- Let % = {(z,p,X) G 5? ; F(z,p,X) > -00}. A direct 
calculation gives the following. 
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Proposition 10. For (z,p,X) E % , it holds that 

F(z,p,X) = -^a(z s ) 2 X ss - b{z s )p s - max {CO, p) {z s p w - p v ) - g(C(z,p))z s p s ,0} , 

where (*(z,p) = h~ x ( — — — — V h(0) ) li„ >o>- In particular F is continuous on . 

V Z sPs J 

Now we prove Theorem HJ We define an open set M = U x M 2 x (0, oo) xS 3 C % . Since 
F is continuous on M and F L converges to F monotonuously, we see that this convergence is 
uniform on any compact set in 3& by Dini's theorem. Similarly, using Dini's theorem again, we 
see that V L converges to V uniformly on any compact set in (0, 1] x U. Then, by the similar 
arguments in the proof of Proposition 4.8 in [15], we obtain the assertion. 

7.7 Proof of Theorem [5] 

Let V?q% xCI be parabolic variants of semijets and T^o^xfi be their closures (see [6].) By 
Proposition [THl we easily show the following lemma. 

Lemma 12. Suppose v is a subsolution (resp., supersolution) of <\3.2ty . Then it holds that 

a + F(z,p,X) <0 (resp., > 0) 

2 -I- 2 — 

for any (a,z,p,X) E (0,1] x Q with (a,p,X) E V {0:1]xn v(z) (resp., (a,p,X) E V {0A]xn v(z) . ) 

We consider the comparison principle on a bounded domain Q C U. 

Proposition 11. Let Q C U be open and bounded. Suppose v (resp., v') be a subsolution 
(resp., supersolution) of on (0, 1] x Q. Moreover suppose v(0, z) < < v'(0, z) for z eVL 
and v < v ' on (0, 1] x dQ. Then it holds that v < v' on (0, 1] x Q. 

By the similar arguments in the proof of Theorem 8.12 in [6], we see that for proving 
Proposition [TT] it suffices to show the following Proposition [121 

Proposition 12. The function F satisfies the following structure condition 

F(z', a(z — z'), Y) — F(z, a(z — z), X) < p (a\z — z'\ 2 + \z — z'\) 

for a. > 1, p E C([0,oo); [0, oo)) with p(0) = 0, z,z' EU,X,Y e S 3 with F(z' , a(z-z'),Y) > 
and 

-*>(!, °r)^( X n ° v )**>( ' (7-29) 



k O I J - \ O -Y J - \ -I I 

where I E M 3 <g) M 3 denotes a unit matrix. 

Proof. The condition F(z', a(z — z'),Y) > implies (z , a(z — z'),Y) E % ', thus it holds that 
either (i) z s > z' s or (ii) z s = z' s and z' s (p w — p' w ) — (p v — p'^) > 0. In each case we have 
F(z, a(z — z'),X) > — oo and 

F(z', a(z - z'), Y) - F(z, a(z - z'),X) 

< ^(o~ 2 (z s )X s s - a 2 (z s )Y s s) + \b(z s ) - b(z' s )\a\z s - z' s \ 

+asup {-(z s - z' s ) 2 g(C) + (z s - z' s )(z w - z'J(} . (7.30) 
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Since the condition (17.291) implies 

a 2 (z s )X ss - a 2 (z' s )Y ss < 3a(a(z s ) - a(z' s )) 2 
and, a and b are both Lipschitz continuous and linear growth, we have 

l -{a 2 (z s )X s s - a 2 (z' s )Y s s) + \b(z s ) - b(z' s )\a\z s - z' s \ < C a\z s - z'f 
for some Co > 0. 

Next we estimate the last term of the right-hand side of f)7.30p . If z s = z' s , it is obvious 

that this term is equal to zero. Then we consider the case of z s > z' s . Since liminf — — > 0, 

we see that there is some (3 > and Co > such that g(() > (3C, 2 for any C > Co- Thus 

sup {-(z s - z' s ) 2 g(C) + (z s - z' s )(z w - z'JC} 
C>o 

< -(^(Co) + Co)|* - A 2 + sup {-(z s - z' s ) 2 P( 2 + (z s - z' s )(z w - z'JC} 



< (g(to) + (o)\z-z'\ 2 + \z s -z' s \\z w -z' w \ x ^™ _" 7) VOj < C 2 \z - z 

for some C\, C 2 > 0. Thus we obtain the assertion. ■ 

Then we obtain Theorem [5] by the similar arguments in the proof of Theorem 7.7.2 in |19j . 
but we should do the calculation carefully. Note especially that the divergence speed of /i~ 1 (C) 
is slower than the linear function C (as C — > oo) and that the function q(w, cp, s) = (w 2 +s 2 + l) m 
(m G N) satisfies 

f / d d \ d 1 

SU P K s ^-l(. w i s) ~ ^-?( w > V, s) - g(Qs—q(w, <p, s) > < C q(w, <p, s) 
(ww)eu { \ ow dip J ds J 

for some C > 0. 



7.8 Proof of Proposition [T] 

First we give the following lemma. 

Lemma 13. Under the assumptions of Section^ there are some (deterministic) functions 
Fl : [0, $ ] — > R such that V£(w, tp, s; u) = w + sF fc n (». 

This lemma is easily proved by mathematical induction. Then we see that the optimal 
strategy in discrete-time model is deterministic. By the proof of Theorem (TJ it holds that the 
optimal strategy in continuous-time model is also deterministic. For (Cr)r- £ ^^(v 9 ); we have 

-t 



and 



E[S t ] = sexp (-fit - J g{Qdrj 
E[Wt] = w + J Cr E[SV]<^ = w + s J Crexp ^— /ir — y g(C„)c^ rfr. 



This implies the assertion. 
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7.9 Proof of Theorem E 

Take any (( r )o<r<t £ ^ c °( ( / ? ) an d let rj r = / ( v dv for r G [0, t\. Then we have 

t / [ r \ f l 1 — e~ a,?t 1 — e~ aip 

C r exp I —jlr — / a( v dv I dr < / e~ ar>r dr\ r = < . 

'o \ Jo J Jo a a 

Since (( r )r £ -4-t(v>) is arbitrary, we get 

1 _ e - Q v 

Vjfiy, </?, s; u) < w H s. (7-31) 

a 

On the other hand, take any 5 G (0, t) and let (Cr)r<t £ ^(v 9 ) b e such that = ^l[o,5]- 
Then we have 

V,(«,, W .; «) > E[W/] = «, + l-«P(-°y-W w 



where (W r )o<r<t is given by ( 12. 6ft with (C r )r- Letting <5 j 0, we get 



1 — e _a¥ ' 

Vtfty, </3, s; m) > w H s. (7.32) 

a 

By (17.311) and (17. 32ft . we obtain the assertion. 
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